Memory Is Relevant In The Symmetric Phase Of The Minority Game 
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Minority game is a simple-mined econophysical model capturing the cooperative behavior among 
selfish players. Previous investigations, which were based on numerical simulations up to about 100 
players for a certain parameter a in the range 0.1 ^ a ^ 1, suggested that memory is irrelevant 
to the cooperative behavior of the minority game in the so-called symmetric phase. Here using a 
large scale numerical simulation up to about 3000 players in the parameter range 0.01 ^ a ^ 1, 
we show that the mean variance of the attendance in the minority game actually depends on the 
memory in the symmetric phase. We explain such dependence in the framework of crowd-anticrowd 
theory. Our findings conclude that one should not overlook the feedback mechanism buried under 
the correlation in the history time series in the study of minority game. 

PACS numbers: 89.65.Gh, 05.70.Fh, 89.75.-k 
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INTRODUCTION 

Minority game (MG) 0,0 is the most studied econo- 
physical model capturing the minority seeking behavior 
of independent selfish players. MG is a repeated game 
of N players, each picking one out of two alternatives 
independently in every time step based on the publicly 
posted minority choices of the previous M turns. Those 
correctly picking the minority choice are awarded one 
mark while the others are deducted one. The aim of each 
player is to maximize his/her own mark. To help play- 
ers making their choices, each of them are assigned once 
and for all S deterministic strategies. Here, each strat- 
egy is a map from the set of all possible minority choices 
of the previous M turns, which we call the history, to 
the set of the two alternatives. The performance of each 
strategy is evaluated according to its virtual score, which 
is defined as the hypothetical mark it would got if the 
strategy were used throughout the game. Among the S 
assigned strategies, every player follows the suggestion of 
the one with the highest current virtual score to choose 
an alternative. (In case of a tie, a player randomly uses 
one of his/her current best working strategies.) 

The number of possible strategies in MG equals 2^". 
Nonetheless, out of these 2^ strategies, only 2^^+^ of 
them are significantly different. These significantly dif- 
ferent strategies formed the so-called reduced strategy 
space. In fact, for a fixed S and up to first order approx- 
imation, the dynamics of MG is robust with a, which is 
the ratio of the reduced strategy space size 2^^+^ to the 
number of strategies at play NS. 0, Q 

The attendance of an alternative A{t) at turn t is 
defined as the number of players choosing that alter- 
native in that turn. Since there is no prior bias in 
choosing the two alternatives in MG, {A{t))^ ^ — N/2 
where the average is taken over time t and initially as- 
signed strategies In contrast, the variance of atten- 



dance per player averaged over initially assigned strate- 
gies, (^a^{A{t)))^ /N, is a more instructive quantity to 

study. (We write {a'^{A{t))) as a and call it simply 
the variance of attendance from now on when confusion 
is not possible.) Numerical simulation shows that, over 
a wide range of parameters, the cr^/iV against a curve 
is lower than the value in which all players make their 
choices randomly. This implies that these selfish and 
independent players maximize their own marks cooper- 
atively. More importantly, a cusp is found at a — ac] 
this second order phase transition point ac divides the 
parameter space into the so-called symmetric (a < ac) 
and asymmetric {a > ac) phases 0. 

The first numerical study on the effect of history con- 
cerning the dynamics and cooperative behavior of MG 
was carried out by Cavagna using N = 101, who sug- 
gested that memory is irrelevant in MG. That is to say, 
the jN against a curve is unaltered if we replace the 
history in each turn with a randomly and independently 
generated AZ-bit string, while keeping the virtual score 
calculation method unchanged 0. (From now on, we 
denote the original MG and the one played using ran- 
dom history strings by MGrcai and MGiand respectively.) 
Later on, by exploring a wider range of parameters in 
their numerical simulations, Challet and Marsili pointed 
out that history is irrelevant if and only \i a < ac- As 
long as the occurrence of history is uniform, jN should 
not change when we replace the history with a randomly 
and independently generated time series of Af-bit string. 
6] Furthermore, Lee argued that although the time se- 
ries of the attendance shows a strong periodic signal, this 
signal does not affect the volatility of the attendance • 
To summarize, the current understanding is that mem- 
ory plays no role on the volatility in the symmetric phase 
of MG. 

In this paper, we perform a large scale numerical simu- 
lation of MG played using real and random histories with 
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up to 3232 players for 0.01 ^ a ^ 10. Our simulation 
results show that memory is in fact relevant in the sym- 
metric phase whenever a ^ 0.2. Specifically, we discover 
that in such a low value of a, the against a curves 

corresponding to the games played using real and random 
histories split. We explain this split by crowd- anticrowd 
theory developed by Hart et al. [3 and argue that 
finite size effect prevents earlier investigations from re- 
vealing this discrepancy. Finally, we report two scaling 
relations in the symmetric phase of MG and explain their 
origin. 



NUMERICAL RESULTS 

All the tJ^'s reported in our simulation are averaged 
over 1000 independent runs. And in each run, the vari- 
ance of attendance is computed from the attendance of 
15000 consecutive turns after the system equilibrates. 
Furthermore, we looked at the attendance time series 
over at least 8 x 10^ iterations in about 50 independent 
runs with various values of a to verify that the system 
has indeed equilibrated. Our computation requires about 
7 Gflops yr of instructions. 

In Fig. n we plot a'^/N against a for different values 
of N for both the MG played using real and random his- 
tories. By putting N — 101, we successfully reproduce 
the two cr^/iV against a curves for MGreai and MGrand 
obtained by Challet and Zhang in Ref. ^g] in the range 
of 0.1 < a < 10. In fact, these two curves coincide in the 
symmetric phase. Surprisingly, by increasing the number 
of players N, a'^/N ior MGreai is consistently higher than 
that of MGrand for a < 0.2. Furthermore, Fig. ^ shows 
that for a fixed a ^ 0.2, a"^ /N for MGrcai increases as N 
increases. In contrast, we find that the a'^ /N against a 
curve for MGrand is independent of A^. Thus, the discrep- 
ancy between the two volatilities increases with N when 
a ^ 0.2. (Although the values of N used in all curves 
reported in this paper are in the form 2*^ x 101 for some 
integer fc, our numerical simulation shows that the same 
conclusions are reached to the case of odd A^.) 

From the above discussions, MGrand follows the scaling 
relation 




FIG. 1: A plot of cr^/A against a by varying M with S = 
2. Fig. ^ compares the dependence of history for N = 101 
(insert) and 3232 (main plot). We represent the MGreai a-nd 
MGrand data by triangles and squares respectively. Fig. ^ 
shows the dependence of /N on N for MGrcai- 




O— G MG^^ , M = 5 
a Q MG^^ , M - 6 
a-AMG^j,M = 5 
X X MG H.M = 6 



FIG. 2: A plot of cr^ against . Each curve is drawn by 
joining a'^ for different at a fixed M with S — 2. 



on M and S only. 



THE CROWD-ANTICROWD EXPLANATION 



N 



(1) 



in the symmetric phase (a < Uc), where cr^^nd vari- 
ance of the attendance for MGrand and / is a scaling func- 
tion depending only on a and S. Moreover, Fig.[21shows 
that, for a fixed memory size M, the value of cr^/A^^ is 
independent of A^ in the symmetric phase. That is to say. 



i{M,S) 
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provided that a < Uc, where cr^^^^ is the variance of atten- 
dance for MGrcai and gi^s are scaling functions depending 



The above numerical findings can be explained by the 
crowd- anticrowd theory proposed by Hart et al. using 
the notion of reduced strategy space . Recall that 
decisions made by two distinct strategies in a reduced 
strategy space are either mutually anti-correlated or un- 
correlated when averaged over all possible history strings. 
Besides, the dynamics is very close to the original MG if 
all strategies are picked from the reduced strategy space 
. In this formalism, the crowd-anticrowd theory states 
that every pair of anti-correlated strategies contributes 
independently to the variance of attendance cr^ |^ 0| . 

To understand the difference in volatility between 
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MGrcai and Mdand, we first review the periodic dy- 
namics observed in the symmetric phase of MGreai 
H H S ES in II3- First, a prominent period 2^+^ 
peak in the Fourier transform of the minority choice time 
series for MGreai is found. We call this phenomenon "pe- 
riod 2^+^ dynamics" . In addition, a conspicuous period 
two peak in the Fourier transform of the time series of 
the minority choice conditioned on an arbitrary but fixed 
history string in MGreai is also observed. We refer this as 
the "period two dynamics" in our subsequent discussions. 
Note that the above two dynamics are also observed by 
replacing the minority choice with attendance. 

For MGroai in the symmetric phase, the number of 
strategies at play is much larger that the reduced strat- 
egy space size. So, it is likely that each strategy in a re- 
duced strategy space is assigned to more than one player 
in this phase. Initially, for a given history string fj,, ev- 
ery alternative has equal chance to win. And the virtual 
score of a strategy (3 that has correctly predicted the 
winning alternative is increased by one while that of its 
anti-correlated strategy /3 is decreased by one. Since the 
Af-bit history string in MGrcai provides complete infor- 
mation of the winning choices in the previous M turns, 
players will prefer to use strategy /? to ;9 at the time when 
the same history string appears next. As more players 
are using the strategy /? in the symmetric phase, these 
players are less likely to guess the minority choice cor- 
rectly. In MGrcai, the history strings of two consecutive 
turns are highly correlated. Actually, one can convert the 
history string in turn t to that of turn {t + 1) by deleting 
the (t— 1 — M)th turn minority choice from one end of the 
former string and then appending the minority choice in 
turn t to the other end. Using these observations, Chal- 
let and Marsili studied the dynamics of MGrcai by means 
of a de Bruijn graph 0. A consequence of their anal- 
ysis is that the history strings in the symmetric phase 
from the (2^^fc -I- l)th to the [2*^ (fc + l)]th turn is likely 
to form a de Bruijn sequence for any natural number k. 
In other words, for any natural number k, an arbitrar- 
ily given history string /i is likely to appear exactly once 
between (2'^k + l)th and [2^' {k + l)]th turns. Besides, 
the history /i is likely to appear exactly twice between 
+ i)th and [2*^+1 (fc + l)]th turns — one of the 
turn at which a particular alternative wins and the other 
turn at which the same alternative loses. As a result, it 
is highly probable that the virtual scores of all strategies 
in the (2*^+^fc + l)th turn agree. Since the decision of 
a player depends on the difference between the virtual 
scores of his/her strategies, the dynamics of the game 
MGrcai has a strong tendency to "reset" itself once every 
2M+1 f^yj-Qs^ This is the origin of the period two and pe- 
riod 2*^+1 dynamics 0, ES El El • Because of the 
above two constraints on the history time series, the time 
series of the minority choice as well as that of the virtual 
score of a strategy in MGrcai are not random walks. 

From the above discussions, we know that the existence 
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FIG. 3: The auto-correlation function Co of the minor- 
ity choice time series averaged over 50 runs for (a) MGreai 
and (b) MGrand- The parameters used in both plots are 
iV = 1616, Af = 5 and S' = 2. 



of period 2^^^^ dynamics is closely related to the follow- 
ing three facts that are unique for MGrcai: the A/-bit 
history string gives complete information on the winning 
alternatives in the previous M turns, the virtual score 
of a strategy is updated according to the current his- 
tory string, and history strings of two consecutive turns 
are highly correlated. In contrast, for MGrand, the his- 
tory string does not correlate with the winning alterna- 
tives, the virtual score is updated according to the histor- 
ical winning alternatives rather than the randomly gen- 
erated history string, and the randomly generated his- 
tory strings in two distinct turns are uncorrelated. Con- 
sequently, although MGrand has a uniformly distributed 
history, it does not have a mechanism to ensure the game 
to "reset" itself once every 2*^+^ turns. Thus, there is no 
reason for its history time series to follow a period 2^^+^ 
dynamics. Indeed, the auto-correlation on the minority 
choice time series in Fig. 13 confirms the absence of period 
2A/+1 dynamics in MGrand although Fig. ^ shows that 
MGrand Still exhibits period two dynamics. Our find- 
ing is consistent with Lee's observation that the history 
occurrence probability density function for MGrcai and 
MGrand are different [7|. To summarize, for a sufficiently 
small a, the entropy of the minority choice time series 
for MGrand IS higher than that of MGrcai- 

We have gathered enough information to explain the 
discrepancy in the jN against a curves between MGrcai 
and MGrand- Recall that period two dynamics is ob- 
served in the symmetric phase of both games. This is 
because a significant number of players are using a par- 
ticular strategy. And according to the crowd-anticrowd 
theory, this results in a high volatility in the symmet- 
ric phase in both games [a 01- Further recall that the 
game MGrcai is very likely to "reset" itself once every 
2^^^^ turns leading to the period 2^^^ dynamics in the 
symmetric phase. In contrast, there is no mechanism 
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FIG. 4: The auto-correlation function Cq of the minority 
choice time series conditioned on a given history string fi av- 
eraged over 50 runs for (a) MGroal a^nd (b) MGrand- The 
parameters used are the same as that in Fig. |31 



to "reset" the game MGrand once a while for a a^. 
Therefore, the absolute deviation of the virtual score dif- 
ference between two distinct strategies for MGrcai is less 
than that for MGrand whenever a <^ ac- Consequently, 
a player in MGjand is more likely to stick to a strategy. 
Hence, players in MGrand cooperate slightly better than 
those in MGroai in the symmetric phase. This explains 
why for any given sufhciently small a, the variance of at- 
tendance per player cr^/iV for MGrcai is higher than that 

of MGrand- 

Why do the a^/N against a curves for MGrcai and 
MGrand coincidc in the symmetric phase in the simula- 
tions of Cavagna , Challet and Zhang together with 
Lee (21]? We believe this is due to the finite size effect 
as they picked = 101 and = 2 in their simulations. 
Due to the small number of players and the small value of 
M involved, the fluctuation between different runs over- 
whelms the discrepancy between MGreai and MGrand- 

After discussing the reason why af^^^ and errand differ, 
we move on to explain the two scaling relations ©-ijlll. 
Researchers have argued that is well approximated by 
a function of a only Indeed, when a > 0.1 and 

hence the number of strategies at play is at most ten 
times the reduced strategy space size, the above approxi- 
mation is reasonably good for MGrcai and MGrand- Nev- 
ertheless, our simulation shows that this approximation 
breaks down in MGreai when a ^ 0.1. On the other hand, 
using mean field approximation, Manuca et al. showed 
that 



N 

T 



3-2 



M 



(3) 



where x is a slow varying function of S provided that a <^ 
OLc 01- Since the correlation between history strings in 
successive turns is ignored in this derivation, the scaling 
relation (^) is applicable to MGrand in the regime of a < 



0.1. In contrast, our simulation shows that this relation 
is not applicable to MGrcai in the same regime. 

Since we have already argued that (j'^^^y{M , S) / N > 
cr^jjjj^(M, S)/N in the symmetric phase, in order to prove 
the validity of relation |5J, it suffices to show that 
^rcai(^' 5) and (r'^^^^iM, S) both scale as iV^ According 
to the crowd-anticrowd theory, for a sufficiently small a, 
all players in MGreai hold strategies whose virtual scores 
are similar. Therefore, most players will not stick to a 
particular strategy when making their choices. Besides, 
the existence of period two dynamics in the symmet- 
ric phase implies that both cr^g^j and CTrand scales as A^^ 
maEini- Thus, relation © holds. 

Finally, we briefly explain why decreases as M in- 
creases. Since the average time between successive ap- 
pearances of a given history increases exponentially with 
M, the absolute deviation of virtual score difference be- 
tween two distinct strategies increases. Therefore, the 
period two dynamics is weakened. So, cr^ for MGrcai and 
MGrand dccrcascs as M increases. 



OUTLOOK 

In this paper, we report that history is relevant in de- 
termining the mean variance of attendance per player for 
MG in the symmetric phase when a ^ 0.2 by an exten- 
sive numerical simulation using real and random histo- 
ries. We explain our finding using crowd-anticrowd the- 
ory. Although all graphs shown in this paper arc drawn 
by fixing the number of strategies per player S" to 2 and 
by letting the strategies to be drawn from the full strat- 
egy space, our conclusions apply equally well to the case 
of S" > 2 as well as the case of drawing strategies from 
the reduced strategy space. Our findings show that the 
feedback mechanism buried under the correlation in the 
history time series is important in the study of volatility 
in the minority game. 

It is instructive to study the relevance of history in the 
parameter region of 0.2 ^ a < ofc. Our numerical simu- 
lation suggests that memory is irrelevant in this regime 
and hence the symmetric phase of MG can be subdivided 
into two phases. Further investigation is needed to test 
our hypothesis. 

Finally, it would be nice if one could analytically solve 
the dynamics of the game in the symmetric phase. Since 
the difference in jN for MGrcai and MGrand in the sym- 
metric phase originates from the in period 2*^+^ dynam- 
ics, any such attempt must take the periodic dynamics of 
the minority choice time series into account — something 
that all attempts using replica trick [isl and generat- 
ing functional method [l^, llfif so far have not been very 
successful to incorporate. 
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